兼容性矩阵
下表显示了互斥的特性以及在某些硬件上的支持情况。
注意:
对于标记为「✗」的条目,您可以通过提供的链接查看不支持的特性或硬件组合的详细跟踪问题。
Feature x Feature
| Feature | CP | APC | LoRA | prmpt adptr | SD | CUDA graph | enc-dec | logP | prmpt logP | async output | multi-step | MM | best-of | beam-search | guided dec |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CP | |||||||||||||||
| APC | ✅ | ||||||||||||||
| LoRA | ✗ | ✅ | |||||||||||||
| prmpt adptr | ✅ | ✅ | ✅ | ||||||||||||
| SD | ✗ | ✅ | ✗ | ✅ | |||||||||||
| CUDA graph | ✅ | ✅ | ✅ | ✅ | ✅ | ||||||||||
| enc-dec | ✗ | ✗ | ✗ | ✗ | ✗ | ✅ | |||||||||
| logP | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ||||||||
| prmpt logP | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ | ✅ | ✅ | |||||||
| async output | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ | ✗ | ✅ | ✅ | ||||||
| multi-step | ✗ | ✅ | ✗ | ✅ | ✗ | ✅ | ✗ | ✅ | ✗ | ✅ | |||||
| MM | ✗ | ✗ | ✗ | ? | ? | ✅ | ✗ | ✅ | ✅ | ✅ | ? | ||||
| best-of | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ | ✅ | ✅ | ✅ | ? | ✗ | ✅ | |||
| beam-search | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ | ✅ | ✅ | ✅ | ? | ✗ | ? | ✅ | ||
| guided dec | ✅ | ✅ | ? | ? | ✅ | ✅ | ? | ✅ | ✅ | ✅ | ✗ | ? | ✅ | ✅ |
Feature x Hardware
| Feature | Volta | Turing | Ampere | Ada | Hopper | CPU | AMD |
|---|---|---|---|---|---|---|---|
| CP | ✗ | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ |
| APC | ✗ | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ |
| LoRA | ✅ | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ |
| prmpt adptr | ✅ | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ |
| SD | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| CUDA graph | ✅ | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ |
| enc-dec | ✅ | ✅ | ✅ | ✅ | ✅ | ✗ | ✗ |
| logP | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| prmpt logP | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| async output | ✅ | ✅ | ✅ | ✅ | ✅ | ✗ | ✗ |
| multi-step | ✅ | ✅ | ✅ | ✅ | ✅ | ✗ | ✅ |
| MM | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| best-of | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| beam-search | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| guided dec | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |